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Speech command input recognition system 

(57) An interactive computer controlled display system with speech command input recognition and visual 
feedback includes means for predetermining a plurality of speech commands for respectively initiating 
corresponding system actions and means for providing for each command an associated set of speech terms 
each term having relevance to its associated command. The system provides means responsive to a detected 
speech command for displaying the command, and means responsive to a detected speech term having 
relevance to one of the commands for displaying the relevant command. The system preferably displays the 
basic speech commands simultaneously along with the relevant commands. 

The means for providing the associated set of speech terms comprise a stored relevance table of 
universal speech input commands and universal computer operation terms conventionally associated with 
actions initiated by the input commands. 
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SPBBCH COMMAND INPUT RECOGNITION SYSTEM 

Technical Field 

The present invention relates to interactive computer controlled 
display systems with speech command input and more particularly to such 
systems which present display feedback to the interactive users. 

Background of Related Art 

The 1990's decade has been marked by a technological revolution 
driven by the convergence of the data processing industry with the 
consumer electronics industry. This advance has been even further 
accelerated by the extensive consumer and business involvement in the 
Internet over the past few years. As a result of these changes it seems 
as if virtually all aspects of human endeavor in the industrialized world 
require human/computer interfaces. There is a need to make computer 
directed activities accessible to people who up to a few years ago were 
computer illiterate or, at best, computer indifferent. 

Thus, there is continuing demand for interfaces to computers and 
networks which improve the ease of use for the interactive user to access 
functions and data from the computer, with desktop- like interfaces 
including windows and icons, as well as three-dimensional virtual reality 
simulating interfaces, the computer industry has been working hard to 
fulfil such user interaction by making interfaces more user friendly by 
making the human/computer interfaces closer and. closer to real world 
interfaces, e.g. human/human interfaces. In such an environment, it 
would be expected that speaking to the computer in natural language would 
be a very natural way of interfacing with the computer for even novice 
users. Despite these potential advantages of speech recognition 
computer interfaces, this technology has been relatively slow in gaining 
extensive user acceptance. 

Speech recognition technology has been available for over twenty 
years, but it has only recently begun to find commercial acceptance, 
particularly with speech dictation or "speech to text" systems, such as 
those marketed by International Business Machines Corporation (IBM) and 
Dragon Systems. That aspect of the technology is now expected to have 
accelerated development until it will have a substantial niche in the 
word processing market. On the other hand, a more universal application 
of speech recognition input to computers, which is still behind 
expectations in user acceptance, is in. command and control technology, 
v-r.ereir., fcr example, a user may navigate through a computer system's 
graphical user interface (GUI) by the user speaking the commands which 
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are customarily found in the systems' menu text, icons, labels, buttons, 
etc . 

Many of the deficiencies in speech recognition both in word 
5 processing and in command technologies are due to inherent voice 

recognition errors due in part to the status of the technology and in 
part to the variability of user speech patterns and the user's ability to 
remember the specific commands necessary to initiate actions. As a 
result, most current voice recognition systems provide some form of 

10 visual feedback which permits the user to confirm that the computer 

understands his speech utterances. In word processing, such visual 
feedback is inherent in this process, since the purpose of the process is 
to translate from the spoken to the visual. That may be one of the 
reasons that the word processing applications of speech recognition has 

15 progressed at a faster pace. 

However, in speech recognition driven command and control systems, 
the constant need for switching back and forth from a natural speech 
input mode of operation, when the user is requesting help or making other 
20 queries, to the command mode of operation, when the user is issuing 

actual commands, tends to be very tiresome and impacts user productivity, 
particularly when there is an intermediate display feedback. 

Summary of the Present Invention 

25 

The present invention is directed to providing solutions to one or 
more of the above -listed needs of speech recognition systems. Preferred 
embodiments of the invention provide command and control systems which 
are heuristic both on the part of the computer in that it learns and 
30 narrows from the natural speech to command user feedback cycles and on 

the part of the user, in that he tends to learn and narrow down to the 
computer system specific commands as a result of the feedback cycles. 

The present invention is directed to an interactive computer 

3 5 controlled display system with speech command input recognition which 

includes means for predetermining a plurality of speech commands for 
respectively initiating each of a corresponding plurality of system 
actions in combination with means for providing, for each of said 
plurality of commands, an associated set of speech terms, each term 

4 0 having relevance to its associated command. Also included are means for 

detect inc speech command and speech terns. Responsive to such detecting 

r 

means, the system provides means responsive to a detected speech command 
for displaying said command, and rear.s .responsive to a detected speech 
term having relevance :c one of said commands for displaying the relevant 
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A system implementing the invention preferably provides interactive 
-ans for selecting a displayed command tQ therefay inl ZZT 
action. TheS e selecting means are preferably speech command input Lans 
The system can display the actual speech commands, i.e.. commands 

I co*rT " USSr Simult — 1- with the relevant commands 

x.e commands not actually spoken but found in response to spoken terms 
havmg relevance to the commands. 

The system of the present invention is particularly effective when 
used m the implementation of distinguishing actual spoken commands f Z 
spoken queries tor help and other purposes. 

in accordance with an aspect of the invention, the means for 

122 7 S3id aSSOC±ated SSt ° f S * ee <* terms comprise a stored relevance 
table of universal speech input commands and universal computer opera" 
terms conventionally associated with actions initiated by said input 
commands, and means for relating the particular interactive interface 
commands of said system with terms in said relevance table. 

in another aspect, the present invention provides a system for 
confirming the recognition of a command by first predetermining a- 
plurality of speech commands for respectively designating each of a 
corresponding plurality of system actions and providing means for 
detecting such speech commands. There also are means responsive to a 
detected speech command for displaying said command for a predetermined 
r Peri ° d ' dU ^S ^ th. user may give a spoken commandTs'op 

the system action designated by said displayed conunand. Xn the event thai 
said system action is not stopped during said predetermined time period 
the system action designated by said displayed command will be execu ed' 

t haYt S h e e r d ne T°7 ait 6XPirati0n ° f «~ — ™ S 

for exit " tZ ^ ri9ht ° ne: ^ SP6eCh — ~ 

p"o 2 thT SyStem 3Cti0n dSSi9nated b ^ sai * ^splayed command 

Prior to tne expiration of said time period. This may be as simple as 
just repeating the displayed command. 

in a further aspect, the invention provides a speech recognition 
system which interprets speech queries such as help queries IndTesents 

of ° £ Pr ° POSed COmmandS S ° rted in ° rder ***** "Pon relevance 

of the commands. The system organi.es the displayed commands being 

Prompted to the user through probability determining means which fl each 
of SD Lc\ mineC PlUrali "' ° f SP6eCh « associated set 

^LLed .ir""" ^ ha '" ln9 rel6VanCe C ° Elated command 

rl u- f "sponsive to a speech query for determining the 

;; V t0 0f SP£eCh fr ° m '» "id query, and means 

7; ° Sai ° ^<**^y determining means for promptiRg tne user 
a c.splayea sequence of commands sorted based upon said probabiM- 
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of speech terms associated with said commands. when such a sorted 
command is selected, the system has means responsive to a speech command 
for carrying out the system action corresponding to the command. 
Preferably, means for determining probability of speech terms weight said 
5 probability upon the firmness of recognition of the speech terms. 

Excellent results are achieved when in determining said probability, a 
firm recognition of a speech term is accorded twice the weight of an 
infirm recognition of the term. Also, if the speech query has a term 
which is an exact match with any command, then in the sorting of 

10 displayed commands, any exact match of a speech term with any command 

doubles the weight accorded to that command in the sorting. The system 
also provides means for adding terms to previous speech terms wherein the 
probability determining means will redetermine probability to include 
such added terms. In such a situation, the probability determining means 

15 will redetermine the weights to include the additional weights of such 

added terms. . 

In a further aspect, the invention provides a speech recognition 
system which does not switch modes of operation when interpreting speech 

20 queries, such as help queries, or receiving actual spoken commands. The 

system handles both concurrently and seamlessly in the same operation 
mode. The present invention is directed to an interactive computer 
controlled display system with speech recognition comprising means for 
predetermining a plurality of speech commands each associated with a 

25 corresponding plurality of system actions in combination with means for 

concurrently detecting speech commands and speech queries for locating 
commands . There is also provided means responsive to a detected speech 
command for carrying out the system action corresponding to the command, 
and means responsive to a detected speech query for attempting to locate 

30 commands applicable to said query. The system also included means for 

displaying the detected speech query together with means for displaying 
located commands applicable to said query. The system may further 
include means responsive to a detected speech query for modifying a 
displayed prior speech query whereby a user may speak a displayed located 

35 command to activate said means for carrying out a system action or speak 

a query to modify said prior query to locate commands other than said 
displayed commands without switching between command and query modes of 
speech detection. 

4C Brief Description of the Drawings 

The present invention will be better understood and its numerous 
advantages will become more apparent to those skilled in the art by 
reference to the following drawings, : " con: unction with the accompanying 
45 description of exar.p I e embodiments, :n which: 
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Fig. i is a block diagram of a generali2ed da processinQ 
-eluding a central processing unit which provides the " co llZr 
controlled interactive display system with voice input used in practicino 
the present invention; Practicing 

Fig. 2 is a block diagram of a portion of the system of Fig i 

l° W Zi a 96neraliZed 6XPanded Vi ~ of 3y Stem co m ponents involved in 

the implementation; in 



Fig. 3 is a diagrammatic view of a display screen on which an 

IT 1 "/ 9 PaRSl intSrfaCe US6d f ° r ViSUal feedb ~* "h.n a speech 
command ana/or speech cerm input has been made; 

15 T 9 ' 4 13 ^ dlSPlay SCreen Vi6W ° f Fig - 3 after • speech term 

15 input has been made; cerm 

Fig. 5 is the display screen view of Fig. 4 after the user has 
finished inputting the speech term in Fig. 4. (The user mav thon 
of the listed commands., .- V thSn Say ° ne 



Fig. 6 is a flowchart of the basic elements of the system and 
Program in a computer controlled display system for creating and using 
the speech command recognition with visual feedback system of the preLnt 
invention: anrf fiesent 



Fig. 



set up i„ Pig ^ fl ° WChart ° f inV ° 1Ved in ^ P- 5 ram 



Detailed Description of the Preferred BnhnH 



lment 



which m! f ° 9 ' 2 ' 3 tyPiCal ^ oc ««»i»« »y-f» is shown 

which may function as the computer controlled display terminal used in 
implementing the system of the present invention by receiving and * 
interpreting speech input and providing a displayed feedback, including 

coIaTT 1Zed 3CCUal COmmandS ' ^ W611 35 3 S " ° f ^Posed -levalt 
commands derived by comparing speech terms (other than commands, to a 
relevance table. A central processing unit (CPU) 10. such as any pc 
microprocessor in a PC available from IBM or Dell Corp. is provided and 
interconnected to various other components by system bus 12 aT 
operating system 41 runs on CPU 10. provides contro! and is 'used to 
^ordinate t.,e function of the various components of Fig. !. operating 

" t, ; o 5 SyStem 3Vailable Cr ° m <0S/2 15 3 trademark 

c. ~ Mcrosorcs Windows 93(TM, or windows NT (TM) , as well as -he 

wN.x or a:x operating systems. A speech recognition program w ich vis .. al 

r_edoac.< or proposed relevant commands, application 40. to be 
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subsequently described in detail, runs in conjunction with operating 
system 41 and provides output calls to the operating system 41, which 
implements the various functions to be performed by the application 40. 

5 A read only memory (ROM) 16 is connected to CPU 10 via bus 12 and 

includes the basic input/output system (BIOS) that controls the basic 
computer functions. Random access memory (RAM) 14, I/O adapter 18 and 
communications adapter 34 are also interconnected to system bus 12. It 
should be noted that software components, including operating system 41 

iO and application 40, are loaded into RAM 14, which is the computer 

system's main memory. I/O adapter 18 may be a small computer system 
interface (SCSI) adapter that communicates with the disk storage device 
20, i.e. a hard drive. Communications adapter 34 interconnects bus 12 
with an outside network enabling the dat^L processing system to 

15 communicate with other such systems over a local area network (LAN) or 

wide area network (WAN) , which includes, of course, the Internet. 1/0- 
devices are also connected to system bus 12 via user interface adapter 22 
and display adapter 36. Keyboard 24 and mouse 26 are all interconnected 
to bus 12 through user interface adapter 22. Audio output is provided by 

20 speaker 28 and the speech input which is made through input device 27, 

which is diagrammaticaiiy depicted as a microphone which accesses the 
system through an appropriate interface adapter 22 . The speech input and 
recognition will be subsequently described in greater detail, 
particularly with respect to Fig. 2. Display adapter 36 includes a frame 

25 buffer 39, which is a storage device that holds a representation of each 

pixel on the display screen 38. Images, such as speech input commands, 
relevant proposed commands, as well as speech input display feedback 
panels, may be stored in frame buffer 39 for display on monitor 38 
through various components such as a digital to analog converter (not 

30 shown) and the like. By using the aforementioned I/O devices, a user is 

capable of inputting visual information to the system through the 
keyboard 24 or mouse 2c in addition to speech input through microphone 27 
and receiving output information from the system via display 38 or 
speaker 28. 

35 

Now with respect to Fig. 2, we will describe the general system 
components involved in implementing the invention. voice or speech input 
50 is applied through microphone 51 which represents a speech input 
device. Since the- art of speech terminology and speech command 

4C recognition is an old and well developed one, we will net go into the 

hardware and system details of a typical system which may be used to 
implement the present invention. It should be clear to those skilled in 
the art that the syscer.s and hardware in any of the following patents may 
be used: US 5 ,671, 323; VS5 , 1 3 3 , 1 1 1 ; *JS5 , 222 , 14 6 ; US5, 664,061; 

45 US5,553,121; and US5,15~,3=4. The speech input to the system could be 

actual sooker. comr-.ancs, which the system will recognize, and/or speech 
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terminology, which the user addresses to the computer so that the 
computer may propose appropriate relevant commands through feedback The 
input speech goes through a recognition process which seeks a comparison 
to a stored set of commands 52. If an actual spoken command is clearly 
identified, spoken command 55. that command may be carried out and then 
displayed via display adapter 36 to display 38. or the spoken command may 
be displayed first and subsequently carried out. in this regard the 
system is capable of several options, as will be subsequently described 
in greatSr detail " Suffice " to state that the present invention 
provides the capability of thus displaying actual commands. 

where the speech input contains terminology other than actual 
commands, the system provides for a relevance table 53. which is usually 
a comprehensive set of terms which may be used in any connection to each 
of the actual stored commands 52. if any of the input speech terms 
compare 54 with one of the actual commands, that actual command is 
characterized as a relevant command 56 which is then also presented to 
the user on display 38 via display adapter 36. Although the relevance 
will be subsequently described in detail, it would be appropriate to 
indicate here how such a table is created. Initially, an active 
vocabulary is determined. This includes collecting from a computer 
operation, including the operating system and all significant application 
programs, all words and terms from menus, buttons and other user 
interface controls including the invisible but active words from 
currently active application windows, all names of macros supplied by the 
speech system, the application and the user, names of other applications 
that the user may switch to, generic commands that are generic to any 
application and any other words and terms which may be currently active 
This basic active vocabulary is constructed into a relevance table 
wherein each word or term will be related to one or more of the actual 
commands and conversely, each of the actual commands will have associated 
with it a set of words and terms which are relevant to the command - t 
should be noted that this relevance table is dynamic in that it may be 
added to as appropriate to each particular computer operation. Let us 
assume that for a particular computer system there is a basic or generic 
relevance table of generic terminology, the active vocabulary for the 
particular system set is added to the basic relevance table and an 
expanded relevant vocabulary is dynamically created using at least some 
ot the following expedients: 

each word or phrase in the active vocabulary is added to the 
expanded vocabulary with an indication that it is an original active 

vocabulary word or phrase; 

. " each W ° rd or phrase in =he active vocabulary is looked up as 

an index into the relevance table. If found, the correspondinc contents 
o- .he ceil in the table are used to further expand the vocabularv wi t "„ 
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any additional words or phrases that the cell may contain. These 
additional terms would have an associated reference to the active entry 
which caused its inclusion; 

each phrase is then broken into its constituent words, word 
5 pairs and n-word subphrases where applicable and the above process 

repeated; 

users may be encouraged to come up with there own lists of 
words and phrases which may be indexed with respect to the relevance 
table; and 

TO - a synonym dictionary may be an additional source for words 

and phrases . 

In the above description of display of commands both spoken and 
relevant with respect to Fig. 2, we did not go into the display of the 

15 spoken input which could include commands and speech terms which would be 

compared to the relevance table for relevant commands. it will be 
understood that the spoken input will also be displayed separately- This 
will be seen with respect to Figs. 3 through 5 which will provide an 
illustrative example of how the present invention may be used to give the 

20 visual feedback of displayed spoken commands, as well as relevant 

commands in accordance with the present invention. when the screen image 
panels are described, it will be understood that these may be rendered by 
storing image and text creation programs, such as those in any 
conventional window operating system in the RAM 14 of the system of Fig . 

25 1. The display screens of Figs. 3 through 5 are presented to the viewer 

on display monitor 38 of Fig. 1. In accordance with conventional 
techniques, the user may control the screen interactively through a 
conventional I/O device such as mouse 26, Fig. 1, and speech input is 
applied through microphone 27. These operate through user interface 22 

30 to call upon programs in RAM 14 cooperating with the operating system 4 1 

to create the images in frame buffer 39 of display adapter 36 to control 
the display panels on monitor 38. The initial display screen of Fig. 3 
shows a display screen with visual feedback display panel 70 . in the 
panel, window 71 will show the words that the user speaks while window 72 

35 will display all of the relevant commands, i.e. commands which were not 

actually spoken, but some the spoker. words or phrases in the window 71 
were associated with the relevant ccmmands through the relevance table, 
as shown in Fig. 2. Also, any spoker. commands which were part of the 
spoken input in window 71 will also be listed along with the relevant 

40 commands in window 72. The par.el also has command buttons: by pressing 

button 73 or saying the command, "C lear List", the user will clear both 
window 7 1 and window 72 in Fig. 3 of all proposed relevant commands and 
input text. Pressing button 74 or saying the command, "Never mind", 
causes the whole application :c go away. Fig. 4 shows the screen panel 

45 7 C of Fig. 3 after the spoken entry, "Display the settings'* . The system 

could f i n d no actual command i n this z e rr. 1 no logy but was able to find t he 
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four relevant commands shown in window 72. Cursor icon 76 is adjacent 
the spoken term in window 71 as an indication that this field is the 
speech focus. m Fig. 5 we have the display of Fig. 4, after the speech 
focus as indicated by cursor icon 76 has been moved to window 73 and the 
user has chosen one of the relevant commands: "Document Properties- 75 
by speaking the command; as a result, the command is highlighted. upon 
the relevant command being spoken, the system will carry it out. 

Now with reference to Figs. 6 and 7 we will describe a process 
implemented by the present invention in conjunction with the flowcharts 
of these figures. Fig. 6 is a flowchart showing the development of a 
process according to the present invention for providing visual feedback 
to spoken commands and other terminology, including a listing of system 
proposed relevant spoken commands which the user may choose from. First, 
step 80, a set of recognizable spoken system and application commands 
which will drive the system being used is set up and sto.red. Then, there 
are set up appropriate processes to carry out the action called for by 
each recognized speech command, step 81. A process for displaying 
recognized speech commands is also set up. in doing so, the program 
developer has the option among others of displaying all recognized 
commands or only recognized commands which are not clearly recognized so 
that the user will have the opportunity of confirming the command. Then, 
step 83, there is set up a relevance table or table of relevant commands' 
as previously described. This table hopefully includes substantially all 
descriptive phrases and terminology associated with the computer system 
and the actual commands to which each term is relevant. a process for 
looking up all spoken inputs, other than recognized commands, on this 
relevance table to then determine relevant commands is set up, step 84. 
This involves combining the system and application commands with the 
relevance table to generate the vocabulary of speech terms which will be 
used by the speech recognition system to provide the list of relevant 
commands. This has been previously described with respect to Fig. 2. 
Finally, there is set up a process for displaying relevant commands so 
that the user may choose a relevant command by speaking to set off the 
command action, step 85. This has been previously described with respect 
to Fig. 5. This completes the set up. 



The running of the process will now be described with respect to 
Fig. 7. First, step 90, a determination is made as to whether there has 
40 been a s Peech input. If No. then the input is returned to step 90 where 

a spoken input is awaited. if the decision from step 90 is Yes, then a 
further determination is mace in decision step 91 as to whether an 
command has beer, definitely recognized.. At this point, we should again 
distinguish, as we have above, between spoken commands which the user 
apparently does not intend to be carried out as commands, i.e., they are 
.just part on the input terminology or spoken query seeking relevant 
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commands, and commands which in view of their presentation context are 
intended as definite commands. If a term in the context of a spoken 
query happens to match one of the commands, it is just listed with the 
relevant commands displayed as subsequently described with respect to 
5 step 97. on the other hand, if a definite command is recognized, then 

the decision at step 91 would be Yes, and the command is carried out in 
the conventional manner, step 92, and then a determination is made as to 
whether the session is at an end, step 93. If Yes, the session is 
exited. If No, the flow is returned to step 90 where a further spoken 

10 input is awaited. If the decision from step 91 was No, that a definite 

command was not recognized, then a comparison is made on the relevance 
table as previously described, step 95, and all relevant commands are 
displayed, step 97, to give the user the opportunity to select one of the 
relevant commands. At decision step 98, a determination is made as to 

15 whether the user has spoken one of the relevant commands. If Yes, then 

the process is returned to step 9 2 via branch "A" and ti)-e command is* 
carried out. If the decision from step 98 is No, then a further decision 
is made, step 99, as to whether the user has spoken any further terms. 
If Yes, the process is returned to step 9 5 where a comparison is made to 

20 the relevance table and the above process is repeated. If the decision 

from step 99 is No, then the process is returned to step 93 via branch 
n B n where a decision is made as to whether the session is over as 
previously described. 

"25 In this specification, the terms, relevant commands and actual 

commands may have been used in various descriptions. Both refer to real 
commands, i.e. commands which the particular system may execute. The 
distinction is based on whether the command is actually spoken. Thus an 
actual command would be one which the user actually speaks whether it be 
30 as part of the spoken entry or query which the user has uttered for the 

purpose of locating relevant commands cr the actual command is one which 
the user intends to be executed in the conventional manner. On the other 
hand, a relevant command would be a command which was not spoken by the 
user but was associated with a word or term in the user's spoken entry 
35 through the relevance table. 

One of the preferred imp 1 e.ne.i :a:ions of the present invention is as 
an application program 40 made up of programming steps or instructions 
resident in HAM 14, Fig. 1, during computer operations. Until required 
'40 by the computer system, the program instructions may be stored in another 

readable medium, e.g. in disk drive 20, or in a removable memory such as 
an optical disk for use in a CZ ROM computer input, or in a floppy disk 
for use in a floppy disk drive computer input. Further, the program 
instructions may be stored in t he ir.erory of another computer prior tc use 
4 5 in the system of the present invention and transmitted over a LAN or a 

wan, such as the Internet, when required by the user c: the present 



11 



invention. One skilled in the art should appreciate that the processes 
controlling the present invention are capable of being distributed in the 
form of computer readable media of a variety of forms. 
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CLAIMS 



1. An interactive computer controlled display system with speech 

command input recognition comprising: 

5 

means for predetermining a plurality of speech commands for 
respectively initiating each of a corresponding plurality of system 
act ions , 

10 means for providing for each of said plurality of commands, an 

associated set of speech terms, each term having relevance to its 
associated command, 



means for detecting speech command and speech terms, 

means responsive to a detected speech command for displaying said 
command, and 

means responsive to a detected speech term having relevance to one 
20 of said commands for displaying the relevant command. 

2. The system of claim 1 further including interactive means for 

selecting a displayed command to thereby initiate a system action. 

2§ 3. The system of claim 2 wherein said means for selecting said 

displayed command includes speech command input means. 

4. The system of any of claims 1 to 2 wherein said speech commands and 
relevant commands are displayed simultaneously. 

30 

5. The system of any one of the preceding claims wherein said means 
for providing said associated set of speech terms include: 

a stored relevance table of universal speech input commands and 
35 universal computer operation terms conventionally associated with actions 

initiated by said input commands, and 

means for relating the particular interactive interface terms cf 
said system with terms in said relevance table. 



45 



6. A method for providing speech command input to an interactive 

computer controlled display system with speech command input recognition 
comprising: 

predetermining a plurality cf speech commands for respectively 
initiating each of a corresponding plurality of system actions, 
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providing for each of said plurality of commands, an associated set 
of speech terms, each term having relevance to its associated command, 

detecting speech command and speech terms, 

displaying a speech command responsive to its detection as a speech 
command, and 

responsive to a detected speech term having relevance to one of 
said commands displaying the relevant command. 

7. The method of claim 6 further including the step of selecting a 
displayed command to thereby initiate a system action in response to a 
user interaction. 

8. The method of claim 7 wherein said step of selecting of said 
displayed command is performed in response to signals from a speech 
command input means. 

9. The method of any one of claims 6 to 8 wherein said speech commands 
and relevant commands are displayed simultaneously. 

10. The method of any one of claims 6 to 9 wherein said step of 
providing said associated set of speech terms includes: 

storing a relevance table of universal speech input commands and 
universal computer operations terms conventionally associated with 
actions initiated by said input commands, and 

relating the particular interactive interface terms of said system 
with terms in said relevance table. 

11. A computer program for speech command input recognition in an 
interactive computer controlled display system, comprising: 

program code for predetermining a plurality of speech commands for 
respectively initiating each of a corresponding plurality of system 
act ions , 

program code for providing for each of said plurality of commands, 
ar. associated set of speech terms, each term having relevance to its 
associated command, 
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program code for detecting speech command and speech terr: 



ms , 
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15 
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program code responsive to a detected speech command for displaying 
said command, and 

program code responsive to a detected speech term having relevance 
to one of said commands for displaying the relevant command. 

12. The computer program of claim 11 further including program code, 
responsive to user interaction, for selecting a displayed command to 
thereby initiate a system action. 

13. The computer program of any one of claims 11 to 12 wherein said 
speech commands and relevant commands are displayed simultaneously. 

14. The computer program of any one of claims 11 to 13 wherein said 
program code for providing said associated set of speech terms includes: 

a stored relevance table of universal speech input commands and 
universal computer operation terms conventionally associated with actions 
initiated by said input commands, and 

means for relating the particular interactive interface terms of 
said system with terms in said relevance table. 

1* A computer program according to any one of claims 11 to 14, 
25 substantially as described herein with reference to any one of figures 1 

to 7 . 

16 A system according to claim 1, wherein said means for displaying 
commands displays a command for a predetermined time, the system further 
30 including: 

means for deselecting a system action designated by a displayed 
command; and 
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means for executing a system action designated by a displayed 
command in the event that the system action is not deselected during said 
predetermined time period. 



